PATENT 0 

H 

Docket No. 1232-4599 \£ 

Express Mail Label No. E.T606949174US 3 ^ 
co" — -~ 
cocr\ 

TN THE IJNTTED STATES PATENT AND TRADEMARK OFFICE 

UTILITY A PPT IC ATION AND APPLICATION FEE TRANSMITTAL H .53(b)) 

ASSISTANT COMMISSIONER FOR PATENTS 
Box Patent Application 
Washington, D.C. 20231 

Sir: 

Transmitted herewith for filing is the patent application of 
Named Inventor(s) and 

Address(es): Yoshiro UDAGAWA, 8-17, Kawabata 3-chome, Miyashiro-machi, Minami Saitama- 

gun, Saitama-ken, Japan 

For: IMAGE PICKUP APPARATUS 

Enclosed are: 

[X] 18 page(s) of specification, J_ page(s) of Abstract, 9 page(s) of claims 

[X]5 sheets of drawing [X] formal [] informal 

[ ] Page(s) of Declaration and Power of Attorney 

[ ] Unsigned 

[ ] Newly Executed 

[ ] Copy from prior application 

[ ] Deletion of inventors including Signed Statement under 37 C.F.R. § 1.63(d)(2) 

[X] Incorporation by Reference: The entire disclosure of the priority application(s) identified below, is 

considered as being part of the disclosure of the accompanying application and is incorporated herein by 
reference. 

[ ] Microfiche Computer Program (Appendix) 

[ ] page(s) of Sequence Listing 

[ ] computer readable disk containing Sequence Listing 

[ ] Statement under 37 C.F.R. § 1.821(f) that computer and paper copies of the Sequence Listing are 
the same 

[X] Claim for Priority Japanese Ap plication No 10-349328 filed 1 1/25/98 
[ ] Certified copy of Priority Document(s) 



504308J 



Docket No 1232-4599 



[ ] 



English translation documents 



[] 



Information Disclosure Statement 



[ ] Copy of Cited references w/ English Abstracts 

[ ] Copy of PTO-1449 filed in parent application serial No. , 

[X] Preliminary Amendment 

[X] Return receipt postcard (MPEP 503) 

[ ] Assignment Papers (assignment cover sheet and assignment documents) 

[ ] A check in the amount of $40.00 for recording the Assignment. 

[ ] Assignment papers filed in parent application Serial No. . 

[ ] Certification of chain of title pursuant to 37 C.F.R. § 3 .73(b). 
[ ] This is a [ ] continuation [ ] divisional [ ] continuation-in-part (C-I-P) of prior application serial no. 

[ ] Cancel in this application original claims of the parent application before 

calculating the filing fee. (At least one original independent claim must be retained for filing 
purposes.) 

[ ] A preliminary Amendment is enclosed. (Claims added by this Amendment have been properly 
numbered consecutively beginning with the number following the highest numbered original 
claim in the prior application. 

[ ] The status of the parent application is as follows: 

[ ] A Petition For Extension of Time and a Fee therefor has been or is being filed in the parent 

application to extend the term for action in the parent application until . 

[ ] A copy of the Petition for Extension of Time in the co-pending parent application is attached. 

[ ] No Petition For Extension of Time and Fee therefor are necessary in the co-pending parent 
application. 

[ ] Please abandon the parent application at a time while the parent application is pending or at a time when 
the petition for extension of time in that application is granted and while this application is pending has 
been granted a filing date, so as to make this application co-pending. 

[ ] Transfer the drawing(s) from the patent application to this application. 

[ ] Amend the specification by inserting before the first line the sentence: 

This is a [ ] continuation [ ] divisional [ ] continuation-in-part of co-pending application Serial 



No. 



filed. 



-2- 



504308_1 



Docket N o 1232-4599 



CALCULATION OF APPLICATION FEE (For Other Than A Small Entity) 











Basic Fee 




Number Filed 


Number Extra 


Rate 


$ 760.00 


Total 
Claims 


24 


-20= 4 


x$ 18.00 


$ 72.00 


Independent 
Claims 


4 


-3= 1 


x78.00 


$ 0 


Multiple Dependent Clain 


is 

[ ]yes 

[ X]no 


Additional Fee = 
Add'IFee 


$260.00 
NONE 


$ 0 



Total: $832.00 

[ ] A statement claiming small entity status is attached or has been filed in the above-identified 
parent application and its benefit under 37 C.F.R. § 1.28(a) is hereby claimed. Reduced 
fees under 37 C.F.R. § 1.9(F) (50% of total) paid herewith $ . 

[ X] A check in the amount of $832.00 for payment of the application filing fees is attached. 

[ ] Charge Fee(s) to Deposit Account No. 13-4500. Order No. . A DUPLICATE COPY OF 

THIS SHEET IS ATTACHED. 

[ X ] The Assistant Commissioner is hereby authorized to charge any additional fees which may be required for 
filing this application, or credit any overpayment to Deposit Account No. 13-4500, Order No. 1232-4599 . 
A DUPLICATE COPY OF THIS SHEET IS ATTACHED. 



Dated: November 19, 1999 



CORRESPONDENCE ADDRESS 

MORGAN & FINNEGAN, L.L.P. 

345 Park Avenue 

New York, New York 10154 

(212) 758-4800 

(212) 751-6849 Facsimile 



Respectfully submitted, 
MORGAN & FI]>*^EpAN, L 




504308J 



Docket No. 1232-4599 



IN THE UNITED STATES PATENT AND TRADEMARK OFFICE 



Applicants 



Yoshiro Udagawa 



Serial No. 



To Be Assigned 



Examiner: 



To Be Assigned 



Filed 



November 19, 1999 (Herewith) 



Group Art Unit: TBA 



For 



IMAGE PICKUP APPARATUS 



EXPRESS MAIL CERTIFICATE 



Express Mail Label No. FJ606949174US 
Date of Deposit November 18. 1999 

I hereby certify that the following attached paper(s) and/or fee 

Application Fee Transmittal (in duplicate); 18 pp. of specs., 1 page of abstract, 9 pp. claims (24 TOTAL 
claims); 5 Sheets of Formal Drawings (Figs. 1-6); check in the amount of $832.00; and return receipt 
postcard 

is being deposited with the United States Postal Service "Express Mail Post Office to Addressee" service under 37 
C.F.R. § 1 . 1 0 on the date indicated above and is addressed to the Assistant Commissioner for Patents, Box New 
Applications, Washington, D.C. 20231. 



CORRESPONDENCE ADDRESS: 

MORGAN & FINNEGAN, L.L.P. 

345 Park Avenue 

New York, New York 10154 

(212) 758-4800 

(212) 751-6849 Facsimile 



Francisco J. Garcia 




Typed or printed name of person 
mailing paner(s) and/or fee) 



Signature of persefi 
paper(s) and/or fee) 



504320_1 



- 1 - 



CFO 14034 US 



Image Pickup Apparatus 

BACKGROUND OF THE INVENTION 
Field of the Invention 

The present invention relates to an image pickup 
method and apparatus and a storage medium storing a 
control program for controlling the image pickup 
apparatus. 

Related Background Art 

Conventionally, white balance processing is 
performed by the following method in a digital camera 
such as an image pickup apparatus. 

As shown in Fig. 6, when the shutter (not shown) 
is depressed to the first stroke ( SW1 ) , white balance 
processing (WB processing) is started by using a 
predetermined white balance coefficient as an initial 
value. After a final white balance coefficient is 
determined upon convergence and completion of this 
processing, the shutter can be depressed to the second 
stroke ( SW2 ) . An image signal is stored in the memory 
at the timing at which SW2 is closed. The data stored 
in the memory is raw data output from a CCD 
(charge-coupled device) or the like. This data is 
subjected to signal processing in a so-called signal 
processing circuit to become recording data. The 
recording data is recorded on a recording medium. The 
white balance coefficient (WB coefficient) immediately 
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before closing of SW2 is obtained as a parameter to be 
used for processing for the recording data and set in 
the signal processing circuit. This parameter is 
recorded on the recording medium after the raw data 
5 stored in the memory is subjected to signal processing. 

In the above conventional apparatus, when image 
pickup is to be performed by using a strobe, strobe 
light is emitted instantaneously at the timing of SW2. 
Consequently, the above processing after SW1 in Fig. 5 

10 (i.e., continuous white balance detection) cannot be 
performed. For this reason, a fixed white balance 
coefficient for predetermined strobe emission is set. 
In some case, therefore, external light influences 
image pickup stronger than strobe light depending on 

15 the object distance, and an object located at a long 

distance and irradiated with reddish tungsten light is 
processed into a red image. 

SUMMARY OF THE INVENTION 

20 The present invention has been made in 

consideration of the above problem in the prior art, 
and has as its object to provide an image pickup method 
and apparatus which can realize accurate white balance 
reproduction and shorten the loop processing time for 

25 white balance processing. 

It is the second object of the present invention 
to provide a storage medium storing a control program 



that can smoothly control the image pickup apparatus of 
the present invention. 

In order to achieve the first object, according to 
the first aspect of the present invention, there is 
provided an image pickup method comprising at least the 
first detection step of calculating a white balance 
coefficient from image signal data before image pickup, 
and the second detection step of calculating a white 
balance coefficient from image signal data after image 
pickup, characterized in that the method further 
comprises the selection step of selecting at least one 
of two types of detection results obtained in the first 
and second detection steps and a computation result 
obtained by computing the two types of detection 
results, the signal processing step of performing 
signal processing by using one of the detection result 
and computation result, selected in the selection step, 
and the output step of outputting at least one of 
processed data subjected to signal processing in the 
signal processing step. 

In order to achieve the first object, according to 
the second aspect of the present invention, in the 
image pickup method according to the first aspect, the 
output step is characterized by displaying an output. 

In order to achieve the first object, according to 
the third aspect of the present invention, in the image 
pickup method according to the first aspect, the output 



step is characterized by recording an output. 

In order to achieve the first object, according to 
the fourth aspect of the present invention, in the 
image pickup method according to the first aspect, the 
first detection step is characterized by a step of 
using live image data used for framing before image 
pickup, and the second step is characterized by a step 
of using still image data obtained by image pickup and 
stored in a memory. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a block diagram showing the system 
configuration of an image pickup apparatus according to 
an embodiment of the present invention; 

Fig. 2 is a flow chart showing the flow of white 
balance processing in the image pickup apparatus 
according to the embodiment; 

Figs. 3A, 3B, 3C and 3D are views showing the 
operation timing of white balance processing in each 
image pickup mode of the image pickup apparatus 
according to the embodiment; 

Fig. 4 is a view showing the relationship between 
the initial value in white balance processing and the 
generation timing of a white balance coefficient for 
signal processing for recording image data in each 
image pickup mode of the image pickup apparatus 
according to the embodiment; 



Figs. 5A and 5B are views showing the operation 
timings of white balance processing and the like in 
image pickup modes ( 1 ) and ( 3 ) of the image pickup 
apparatus according to the embodiment; and 

Fig. 6 is a view showing white balance processing 
in the prior art. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

Each embodiment of the present invention will be 
described below with reference to the accompanying 
drawings . 

The first embodiment of the present invention will 
be described first. 

Fig. 1 is a block diagram showing the system 
configuration of a digital still camera as an image 
pickup apparatus according to an embodiment of the 
present invention. Referring to Fig. 1, this camera is 
comprised of an optical system 1 including a lens and 
the like, a photoelectric conversion element (CCD in 
this embodiment) 2 for converting an optical signal 
from the optical system 1 into an electrical signal, a 
CDS (Correlation Double Sampling) circuit 3 for 
converting an output signal from the CCD 2 into a video 
signal, an A/D converter 4 for converting an analog 
signal output from the CDS circuit 3 into a digital 
signal, a memory controller 5 for controlling a memory 
9 (to be described later), a system controller 6 for 
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generating a signal for driving a CCD driver (not 
shown) and controlling the memory controller 5, a D/A 
converter 7 for converting a digital signal output from 
the memory controller 5 into an analog signal, a 
5 display unit 8 such as a color liquid crystal display 
for displaying data, picked image, and the like, the 
memory 9 such as a RAM used to store image data, a 
compression circuit 10 for compressing an image signal 
by a compression scheme such as JPEG, a DSP (Digital 

10 Signal Processor) 11 for performing various signal 

processes such as color signal processing and luminance 
signal processing, an EEPROM (Electrically Erasable 
Programmable Read Only Memory) 12 used to hold a white 
balance coefficient (WBstd) for a standard light 

15 source, a white balance coefficient (WBfl) for first 
strobe light, a white balance coefficient (WBf2) for 
second strobe light, and the like, a card memory 13 in 
which image-picked data and the like are stored, a 
release switch 14 as a two- stroke switch which is 

20 depressed to the first stroke to turn on the first 
switch SW1 and is depressed to the second stroke to 
turn on the second switch SW2, and a strobe control 
circuit 15 for controlling a strobe (not shown). 

Referring to Fig. 1, an object image (not shown) 

25 is formed on the image pickup surface of the CCD 2 
through the optical system 1 . The electric signal 
generated by photoelectric conversion performed by the 



CCD 2 is input as an output signal form the CCD 2 to 
the CDS circuit 3 and A/D converter 4 to be converted 
into a video signal and digital signal. Thereafter, 
the resultant data is stored as one- frame data in the 
memory 9 through the memory controller 5 . The image 
data in the memory 9 is subjected to signal processing 
in the DSP 11 through the memory controller 5. The 
resultant data is compressed by the JPEG circuit 10 and 
recorded on the card memory 13 through an I/F 
(interface) 16. 

If an image display switch (not shown) is turned 
on, the data having undergone A/D conversion in the A/D 
converter 4 is directly input to the DSP 11 without 
being stored in the memory 9. After the data is 
subjected to signal processing in the DSP 11, the 
resultant data is output to the display unit 8 through 
the D/A converter 7. 

Basic operation of white balance processing will 
be described next with reference to the flow chart of 
Fig. 2. 

When white balance processing is started, an 
initial value is read out in step S201 . In step S202, 
a white balance coefficient (WB coefficient) is set in 
the DSP 11 in Fig. 1. In step S203, white balance data 
(WB data) is obtained in accordance with the white 
balance coefficient set in step S202. In step S204, it 
is checked whether the white balance data obtained in 



step S203 is less than a predetermined value. If YES 
in step S204, the white balance coefficient is 
determined, and the processing is terminated. 

If it is determined in step S204 that the white 
balance data is not less than the predetermined value, 
the following loop is repeated. In step S205, the 
value of the white balance coefficient is changed. The 
flow then returns to step S202 to set the white balance 
coefficient again. In step S203, white balance data is 
obtained. In step S204, it is checked whether the 
white balance data obtained in step S203 is less than 
the predetermined value. 

While the current image picked by the CCD 2 is 
displayed on the display unit 8 in FIG. 1, the above 
white balance processing is consecutively performed at 
predetermined intervals to correct the white balance of 
the image displayed on the display unit 8. 

White balance processing to be performed in each 
image pickup mode will be described next with reference 
to Figs. 3A to 3D. 

( 1 ) When Display Unit 8 Is On without Strobe 
(Fig. 3A) 

The current image picked by the CCD 2 is displayed 
on the display unit 8, and white balance processing has 
already been performed consecutively before SW1 . When 
the first switch SW1 is turned on by the release switch 
14, the DSP 11 computes the white balance coefficient 



during the interval between SW1 and SW2 on the basis of 
the image signal obtained when the first switch SW1 is 
turned on. The computed coefficient is stored as a 
white balance coefficient WBswl in the memory 9. In 
this state, the second switch SW2 can be turned on, and 
ON operation of SW2 is inhibited until the WB 
processing is complete. When the second switch SW2 is 
turned on, the image data picked by the CCD 2 is stored 
in the memory 9. The image data stored in the memory 9 
is subjected to signal processing using the white 
balance coefficient (WBswl). 

In mode ( 1 ) , since the interval between SW1 and 
SW2 is short, the color temperature of the image signal 
obtained from the CCD 2 when the first switch SW1 is 
turned on is close to that of the image signal obtained 
from the CCD 2 when the second switch SW2 is turned on. 
For this reason, WB processing can be performed faster 
in this mode than in a case wherein WB processing is 
performed by using a predetermined value SBstd when the 
first switch SWl is turned on. That is, the 
computation interval between SWl and SW2 is shortened. 
This prevents the user from missing the shutter chance. 

(2) When Display Unit 8 Is Off without Strobe 
(Fig. 3B) 

When the first switch SWl is turned on by the 
release switch 14, the first switch SWl can be turned 
on without performing white balance processing at this 
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timing. When the second switch SW2 is turned on, the 
image data picked by the CCD 2 is stored in the memory 
9. The DSP 11 starts white balance processing for the 
image data stored in the memory 9 by using a 
predetermined white balance coefficient WBstd as an 
initial value. The image data is then subjected to 
signal processing using a white balance coefficient 
(WBsw2) computed by the white balance processing. 

In mode (2), since white balance processing is 
executed by using the predetermined white balance 
coefficient WBstd as an initial value, the processing 
time is long. However, since WB processing is executed 
after the image signal is obtained, i.e., the second 
switch SW2 is turned on, the interval between SW1 and 
SW2 is not prolonged. This allows the user to perform 
appropriate image pickup. 

( 3 ) When Display Unit 8 is ON with First Strobe 
(Fig. 3C) 

The current image picked by the CCD 2 is displayed 
on the display unit 8, and white balance processing has 
been performed before SW1 . When the first switch SW1 
is turned on by the release switch 14, the DSP 11a 
computes the white balance coefficient during the 
interval between SW1 and SW2 on the basis of the image 
signal obtained when the first switch SW1 is turned on. 
This computed coefficient is stored as the white 
balance coefficient WBswl in the memory 9. In this 
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state after computation of the white balance 
coefficient WBswl, the second switch SW2 can be turned 
on. When the second switch SW2 is turned on, the first 
strobe synchronously emits light. The image data 
picked by the CCD 2 at this time is stored in the 
memory 9 . White balance processing for the image data 
stored in the memory 9 is started by using the average 
value of the computed coefficient WBswl and 
predetermined strobe coefficient WBfl as an initial 
value. Signal processing for the image data is then 
performed by using the average value of the white 
balance coefficient (WBsw2), obtained when this white 
balance processing is complete, and the white balance 
coefficient (WBfl) for the first strobe. 

In mode ( 3 ) , since the average value of the white 
balance coefficient WBswl computed before strobe 
emission and the white balance coefficient WBfl for 
strobe emission is computed as an initial value, WB 
processing can be speeded up. In addition, since the 
average value of the white balance coefficient WBsw2 
obtained by WB processing and the predetermined strobe 
coefficient is used as an actual white balance 
coefficient, color signal processing resistant to the 
influences of external light can be performed. This 
also prevents the user from missing the shutter chance. 

(4) When Display Unit 8 is OFF with First Strobe 
(Fig. 3D) 
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When the first switch SW1 is turned on by the 
release switch 14, the second switch SW2 can be 
immediately turned on without performing white balance 
processing at this timing. When the second switch SW2 
is turned on, the first strobe synchronously emits 
light, and the image data picked by the CCD 2 is stored 
in the memory 9 . White balance processing for the 
image data stored in the memory 9 is started by using 
the average value of the predetermined coefficient 
WBstd for standard light and predetermined strobe 
coefficient WBfl as an initial value. Signal 
processing for the image data is then performed by 
using the average value of the white balance 
coefficient (WBsw2) computed by the white balance 
processing and white balance coefficient (WBfl) for the 
first strobe. 

In mode ( 4 ) , as in mode ( 2 ) , since WB processing 
is executed after the second switch SW2 is turned on, 
the interval between SWl and SW2 is shortened to 
prevent the user from missing the shutter chance. In 
addition, since the average value of the white balance 
coefficient obtained by WB processing and the 
predetermined strobe coefficient is used as an actual 
white balance coefficient, color signal processing 
resistant to the influences of external light can be 
performed . 

Note that if the second strobe is mounted in place 



- 13 - 



of the first strobe, a white balance coefficient (WBf2) 
for the second strobe is used in place of the white 
balance coefficient WBfl. 

Fig. 4 shows the relationship between the initial 
value in white balance processing and the white balance 
coefficient for signal processing in each of image 
pickup modes (1) to (4) described above. 

With this arrangement, a more accurate white 
balance coefficient can be obtained in each image 
pickup mode. In addition, since an initial value 
closer to a convergence value can be set in loop 
processing for white balance processing, the 
convergence time can be shortened. 

In the first embodiment, the white balance 
coefficient for the strobe is stored in the EEPROM 12 
in the camera body in advance. However, the present 
invention is not limited to this. According to another 
embodiment, a white balance coefficient is stored in 
the strobe, and the stored white balance coefficient is 
read out every time an image is picked up. 
Alternatively, this white balance coefficient may be 
read out from the strobe and stored in the camera body 
when the strobe is mounted. 

According to the first embodiment described above, 
in modes ( 1 ) and ( 3 ) , the white balance coefficient 
WBswl is computed within the interval between SW1 and 
SW2 on the basis of the image signal obtained when the 
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first switch SW1 is turned on. In modes (1) and (3), 
however, since white balance processing has been 
continuously performed before the first switch SW1 is 
turned on, the white balance coefficient computed at 
the ON timing of the first switch SW1 may be used as 
the coefficient WBswl . This eliminates the necessity 
to perform white balance processing within the interval 
between SW1 and SW2, and can shorten the interval 
between SW1 and SW2, thereby preventing the user from 
missing the shutter chance. 

Figs. 5A and 5B are timing charts each showing 
image pickup operation in such an image pickup mode. 
Fig. 5A is a timing chart showing image pickup 
operation to be performed when the display unit is ON 
and strobe emission is OFF. This operation corresponds 
to mode ( 1 ) . Fig . 5B is a timing chart showing image 
pickup operation to be performed when both the display 
unit and strobe emission are ON. This operation 
corresponds to mode ( 3 ) . Both the operations in 
Figs. 5A and 5B are processed in the same manner as in 
the first embodiment except that the apparatus obtains 
the white balance coefficient WBswl at the timing of 
SW1 instead of obtaining the white balance coefficient 
WBswl within the interval between SW1 and SW2 . 
Therefore, a description of this operation will be 
omitted. 

In each embodiment described above, finally 
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processed image data may be stored in the card memory 
13 and displayed on the display unit 8. 

In each embodiment described above, image data 
processed with only one white balance coefficient is 
recorded. However, the present invention is not 
limited to this, and image data processed with a 
plurality of different white balance coefficients may 
be recorded. In addition, after two different types of 
processed image data are displayed on the display unit 
8, one of the two types of processed image data may be 
selected by using a selecting device ( not shown ) , and 
only the selected image data may be recorded. 

In each embodiment described above, the average 
value of the white balance coefficients WBsw2 and WBfl 
is used as a white balance coefficient for signal 
processing for recording data when the strobe is used. 
However, the present invention is not limited to this. 
If the performance of the strobe is poor, only the 
white balance coefficient WBsw2 may be used. 

In each embodiment described above, the external 
strobe mounted on the camera body has been exemplified. 
However, the present invention is not limited to this, 
and can be applied to a built-in strobe incorporated in 
the camera body. 

In each embodiment described above, the average 
value of two white balance coefficients is computed. 
However, the present invention is not limited to this. 
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When a white balance coefficient for the strobe is to 
be computed, in particular, the amount of light emitted 
by the strobe is detected, and the ratio of the amount 
of external light to the amount of light emitted by the 
strobe is calculated. A white balance coefficient 
corresponding to an internally dividing point between 
the white balance coefficients WBsw2 and WBfl may be 
used in accordance with the calculated ratio. 

As has been described in detail above, according 
to the image pickup method and apparatus of each 
embodiment described above, accurate white balance 
reproduction can be realized by setting an initial 
value and acguiring an appropriate white balance 
coefficient, and the loop processing time for white 
balance processing can be shortened. 

In addition, according to the storage medium of 
each embodiment described above, the above image pickup 
apparatus can be smoothly controlled. 

The objects of the present invention are also 
achieved by supplying a storage medium, which records a 
program code of a software program that can realize the 
functions of the above-mentioned embodiments to the 
system or apparatus, and reading out and executing the 
program code stored in the storage medium by a computer 
(or a CPU or MPU) of the system or apparatus. 

In this case, the program code itself read out 
from the storage medium realizes the functions of the 
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above-mentioned embodiments, and the storage medium 
which stores the program code constitutes the present 
invention. 

As the storage medium for supplying the program 
code, for example, a floppy disk, hard disk, optical 
disk, magneto-optical disk, CD-ROM, CD-R, magnetic 
tape, nonvolatile memory card, ROM, and the like may be 
used. 

The functions of the above-mentioned embodiments 
may be realized not only by executing the readout 
program code by the computer but also by some or all of 
actual processing operations executed by an OS 
(operating system) running on the computer on the basis 
of an instruction of the program code. 

Furthermore, the functions of the above-mentioned 
embodiments may be realized by some or all of actual 
processing operations executed by a CPU or the like 
arranged in a function extension board or a function 
extension unit, which is inserted in or connected to 
the computer, after the program code read out from the 
storage medium is written in a memory of the extension 
board or unit. When the present invention is applied 
to the above storage medium, the program codes 
corresponding to above flow chart are stored in the 
storage medium. In brief, an indispensable module for 
the camera control system of the present invention is 
stored in the storage medium. 
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Many widely different embodiments of the present 
invention may be constructed without departing from the 
spirit and scope of the present invention. It should 
be understood that the present invention is not limited 
to the specific embodiments described in the 
specification, except as defined in the appended 
claims . 
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WHAT IS CLAIMED IS: 

1. An image pickup apparatus comprising: 

image pickup means for picking up an image of an 

ob j ect ; 

operation means for operating an image pickup 
timing for image picking up the object to be recorded ; 
and 

white balance control means, having a first mode 
of acquiring information about white balance in 
accordance with first operation by said operation means 
and executing image pickup operation of said image 
pickup means in accordance with second operation at a 
timing after the first operation timing, and a second 
mode of acquiring information about white balance in 
accordance with the second operation, for controlling 
white balance of an image picked up in accordance with 
the second operation on the basis of the information 
about white balance which are obtained in the first and 
second modes. 

2. An apparatus according to claim 1, wherein 
said apparatus further comprises display means for 
displaying an image picked by said image pickup means, 
said white balance control means controls white balance 
of the image displayed by said display means, and the 
information about white balance which is acquired in 
the first mode uses information about the white balance 
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of -the image displayed by said display means. 

3. An apparatus according to claim 2, wherein 
said white balance control means computes information 
about white balance in the first mode on the basis of 
the image picked up by said image pickup means at the 
first operation timing. 

4. An apparatus according to claim 2, wherein 
said white balance control means uses information about 
white balance which is used for controlling white 
balance of the image displayed by said display means at 
the first operation timing, as information about white 
balance in the first mode. 

5. An apparatus according to claim 1, wherein 
said white balance control means acquires information 
about white balance in the second mode on the basis of 
the image picked up in accordance with the second 
operation. 

6. An apparatus according to claim 1, further 
comprising : 

strobe means for illuminating an object; and 
storage means storing information about white 
balance when said strobe means illuminates the object, 
wherein said white balance control means computes 
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information about white balance of the image picked up 
in accordance with the second operation by using a 
white balance coefficient, as an initial value, which 
is obtained on the basis of information about white 
balance acquired on the basis of the first operation 
and information about white balance stored in said 
storage means, when said white balance control means 
causes said strobe means to illuminate the object in 
the first mode. 

7. An apparatus according to claim 6, wherein 
said white balance control means controls white balance 
of the image picked up in accordance with the second 
operation on the basis of a white balance coefficient 
computed on the basis of computed information about 
white balance and information about white balance 
stored in said storage means, when said white balance 
control means causes said strobe means to illuminate 
the object in the first mode. 

8. An apparatus according to claim 6, wherein 
said white balance control means controls white balance 
of the image picked up in accordance with the second 
operation on the basis of information about white 
balance acquired in the second mode and information 
about white balance stored in said storage means, when 
said white balance control means causes said strobe 
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means to illuminate the object in the second mode. 

9. An image pickup method comprising: 
an image pickup step of picking up an image of an 
5 object; 

an operation step of operating an image pickup 

timing for image picking up the object to be recorded; 

and 

a control step, having a first mode of acquiring 
10 information about white balance in accordance with 

first operation and executing image pickup operation in 
the image pickup step in accordance with second 
operation at a timing after the first operation timing, 
and a second mode of acquiring information about white 
15 balance in accordance with the second operation, of 
controlling white balance of an image picked up in 
accordance with the second operation on the basis of 
the information about white balance which are obtained 
in the first and second modes. 

20 

10. A method according to claim 9, further 
comprising a display step of displaying an image picked 
in the image pickup step, wherein said control step 
controls white balance of the displayed image, and the 
25 information about white balance which is acquired in 

the first mode uses information about the white balance 
of the image displayed in said display step. 



- 23 - 



11. A method according to claim 9, wherein said 
control step computes information about white balance 
in the first mode on the basis of the image picked up 
in the image pickup step at the first operation timing. 

12. A method according to claim 10, wherein said 
control step uses information about white balance which 
is used for controlling white balance of the image 
displayed in said display step at the first operation 
timing, as information about white balance in the first 
mode. 

13. A method according to claim 9, wherein said 
control step acquires information about white balance 
in the second mode on the basis of the image picked up 
in accordance with the second operation. 

14. A method according to claim 9, further 
comprising: 

an illumination step of illuminating an object; 

a storing step of storing information about white 
balance when the object is illuminated in said 
illumination step; and 

wherein said control step computes information 
about white balance of the image picked up in 
accordance with the second operation by using a white 
balance coefficient, as an initial value, which is 
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obtained on the basis of information about white 
balance acquired on the basis of the first operation 
and stored information about white balance, when the 
object is illuminated in said illumination step in the 
first mode. 

15. A method according to claim 14, wherein said 
control step controls white balance of the image picked 
up in accordance with the second operation on the basis 
of a white balance coefficient computed on the basis of 
computed information about white balance and stored 
information about white balance, when the object is 
illuminated in said illumination step in the first 
mode. 

16. A method according to claim 14, wherein said 
control step controls white balance of the image picked 
up in accordance with the second operation on the basis 
of information about white balance acquired in the 
second mode and stored information about white balance, 
when the object is illuminated in said illumination 
step in the second mode. 

17. A recording medium for computer-readable 
storing a program for executing an image pickup method, 
the image pickup method comprising: 

an image pickup step of picking up an image of an 
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ob j ect ; 

an operation step of operating an image pickup 
timing for image picking up the object to be recorded ; 
and 

a control step, having a first mode of acquiring 
information about white balance in accordance with 
first operation and executing image pickup operation in 
the image pickup step in accordance with second 
operation at a timing after the first operation timing, 
and a second mode of acquiring information about white 
balance in accordance with the second operation, of 
controlling white balance of an image picked up in 
accordance with the second operation on the basis of 
the information about white balance which are obtained 
in the first and second modes. 

18. A medium according to claim 17, wherein the 
method further comprises a display step of displaying 
an image picked in the image pickup step, said control 
step controls white balance of the displayed image, and 
the information about white balance which is acquired 
in the first mode uses information about the white 
balance of the image displayed in said display step. 

19. A medium according to claim 18, wherein said 
control step computes information about white balance 
in the first mode on the basis of the image picked up 
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in the image pickup step at the first operation timing. 

20. A medium according to claim 18, wherein said 
control step uses information about white balance which 
is used for controlling white balance of the image 
displayed in said display step at the first operation 
timing, as information about white balance in the first 
mode. 

21. A medium according to claim 17, wherein said 
control step acquires information about white balance 
in the second mode on the basis of the image picked up 
in accordance with the second operation. 

22. A medium according to claim 17, wherein the 
method further comprises: 

an illumination step of illuminating an object; 

a storing step of storing information about white 
balance when the object is illuminated in the 
illuminating step; and 

computing information about white balance of the 
image picked up in accordance with the second operation 
by using a white balance coefficient, as an initial 
value, which is obtained on the basis of information 
about white balance acquired on the basis of the first 
operation and stored information about white balance, 
when the object is illuminated in said illumination 
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step in the first mode. 

23. A medium according to claim 22, wherein said 
control step controls white balance of the image picked 
up in accordance with the second operation on the basis 
of a white balance coefficient computed on the basis of 
computed information about white balance and stored 
information about white balance, when the object is 
illuminated said illumination step in the first mode. 

24. A medium according to claim 22, wherein said 
control step controls white balance of the image picked 
up in accordance with the second operation on the basis 
of information about white balance acquired in the 
second mode and stored information about white balance, 
when the object is illuminated in said illumination 
step in the second mode. 
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ABSTRACT OF THE DISCLOSURE 

An image pickup method and apparatus which can 
realize accurate white balance reproduction and shorten 
the loop processing time for white balance processing 
5 are provided. A system controller selects at least one 
of the white balance coefficient calculated from image 
signal data before image pickup, the white balance 
coefficient calculated from image signal data after 
image pickup, and the result obtained by computing the 
10 two white balance coefficients, and displays at least 
one of processed data subjected to signal processing 
using the selected white balance coefficient on a 
display unit. 
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